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Abstract 

The claim arrival process to an insurance company is modeled by a compound Poisson 
process whose intensity and/or jump size distribution changes at an unobservable time with 
a known distribution. It is in the insurance company's interest to detect the change time as 
soon as possible in order to re-evaluate a new fair value for premiums to keep its profit level 
the same. This is equivalent to a problem in which the intensity and the jump size change at 
the same time but the intensity changes to a random variable with a know distribution. This 
problem becomes an optimal stopping problem for a Markovian sufficient statistic. Here, a 
special case of this problem is solved, in which the rate of the arrivals moves up to one of 
two possible values, and the Markovian sufficient statistic is two-dimensional. 



1 Introduction 

In insurance risk theory, the claim arrivals are modeled by a compound Poisson process. The 
total claim up to time t is given by 

N t 

X t = X + J2 Y k, t>0, (1.1) 

k=l 

where the number of claims up to time t, Nt, is a Poisson process with intensity Ao- The claim 
size process (Yfc)fceN is assumed to consist of independent and identically distributed R d valued 
random variables with distribution function vq. In order to compensate for the liabilities the 
insurance company has to pay out, it collects premiums at a such rate that it has a fair chance 
of survival. 

In this paper, we will study the model in (jl.ip with two types of regime shift. At time 6 a the 
intensity of the Poisson process changes from Ao to Ai, and at time 9 b , the distribution of the 
claim size changes from vq to v\. (These measures are assumed to be absolutely continuous with 
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respect to each other.) Both 6 a and 9 b are unknown at time 0, and they are unobservable. It is 
in the insurance company's interest to detect the change time or the disorder time 9 = 9 a A9 b = 
mm{9 a ,9 b } as soon as possible and to re-evaluate a new fair value for premiums in order to keep 
the profit level the same. 

We assume that the times of regime shift are independent of each other and that they have 
an exponential prior distribution 

F{6 i >t} = {l-TT i )e- XH , ie{a,b}, t>0, 

for A* > 0. At time 9, we do not know what the intensity is for sure: it is either Ao (a change 
has occurred in the distribution of the claim size) or Ai (a change occurred in the intensity). In 
fact at time 9, the value of intensity changes from Ao to the random variable A where 

Ai with probability 
Aq with probability 



A=<! J (1.2) 

x a +x b ' 



At time 9 the distribution of the claim size changes from vq to u, where 



A a X b 

u , xh vi- (1.3) 



A a + X b u X a + X b 

Now consider a related more general problem in which at the disorder time 9 the compound 
process introduced in (jl.ip changes its intensity from /i E R + to a random variable A (at first 
we will first allow the distribution of this random variable to be as general as possible) and 
the distribution of the claim sizes change from (3$ to (3\ (these two measures are assumed to be 
absolutely continuous with respect to each other). The distribution of 9 is given by 

P{9 = 0} = 7T, F{9 > t\9 > 0} = e~ xt , t > 0. (1.4) 

The random variables A and 9 are independent. 

In this more general problem the aim is to detect the unknown and unobservable time 9 as 
quickly as possible given the observations from the incoming claims. More precisely, we would 
like to find a stopping time r of the observation process that minimizes the penalty function 

R t (tt) = F{t <9} + cE[t -9} + , (1.5) 

which is the sum of the frequency of P(r < 9) false alarms and the expected cost cE [(r — 9) + ] 
of detection delay. 

We are interested in solving this more general problem for three reasons. First, setting it = 0, 
A = A a + X b , fi = Ao, Po = u o an d 0i = u, and the distribution of A to be the Bernoulli 
distribution in (|1.2p we see that solving this more general problem also leads to a solution of 
the main problem introduced in the second paragraph. Second, in the general problem if we 
set A to be a constant, then we obtain a version of the main problem in which the rate change 
an d change of the distributio n of the claim sizes occur simultaneously. This case was analyzed 
bv lDavanik and SezeiJ (j200fih and lGapeev! (j2005h . Finally, the more general problem represents 



a situation in which the insurance company has only some apriori information about the post 
disorder rate Ai, but the company can not pin Ai down to a constant because it might only 
have very few claims after the regime change occurs. In fact, the company wants to detect the 
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regime change as soon as possible, so there is not really any time to collect data to estimate Ai. 
This change detectio n problem when the und erlying process X is a (simple) Poisson process was 
recently analyzed by Bavraktar et al. ( 20061 ). This corresponds to setting /3 = vq and j3\ = u 
in the current setting. 

The compound/simple Poisson disorder problem is one of the rare instances in which a stochas- 
tic control problem with partial information can be handled. The (simple) Poisson disorde r 
problem wit h lin ear penalty for delay was partially solved by iGalchuk and R ozovskv (1971), 
Davisl (Il976h andbavis and War] dl977h . This problem later was solved bv lPeskir and Shirvaevi 



(|2002l ). iBavraktar and Davaniki (120061) solved th e simple Poisson disorder problem for exponen 



T hese results were recent ly ext ended by 



m 



Bayraktar et al.l (120061)') a nd lGapeevi ( 



tial penalty for delay, and IBavraktar et al.l (120051) solved the stand ard Poisson disorder problem. 



Davanik and Sezer |2006) (using the results developed 



2005) for compound Poisson procesesses. On the other 



hand Bayraktar et al. ( 20061 ) solved the simple Pois s on di sorder problem when the post disorder 
rate is a random variable and Bavraktar and Sezer ( 2006') solved this problem for the case with 
a Phase-type disorder distribution. 

We will first show that our pr oblem is equivalent to a n optimal stopping problem for a Marko- 
vian sufficient statistic. As in IBavraktar et al. tod ) it turns out that the dimension of the 
sufficient statistic is finite dimensional if the distribution of the random variable A is discrete 
with finitely many atoms. We will study the case of a binary distribution in more detail. In 
particular, we will analyze the case when the post-disorder rate only goes up. We are able to 
show that the intuition that a decision would sound the alarm only at the times when it observes 
an arrival does not in general hold, see Remark 15.11 This intuition becomes relevant only when 
A and c are small enough, i.e. when the disorder intensity and delay penalty are small. By per- 
forming a sample path analysis we are able to find the optimal stopping time exactly for most 
of the range of parameters. For the rest of the parameter range we provide upper and lower 
bounds on the optimal stopping time. To show the existence of the optimal stopping problem 
for the cases when we can not determine it exactly we make use of the characterization of the 
value function o f the optimal stopping time as the fixed point of a functional operator, as in 
Bavraktar etaD (|2006l ). We use this approach since the free boundary problems associated with 
our problem turns out to be quite difficult to manage as it involves integro-differential equations 
and the failure of the smooth fit principle is expected. This characterization can be used to 
calculate the value function through an iterative procedure. From this characterization we are 
able to infer that the free boundaries are decreasing convex curves located at the corner of . 
Using our sample path analysis, we are able to determine a certain subset of the free boundary 
exactly. 

The rest of the paper is organized as follows. In Section [2j we give a more precise probabilistic 
description of the disorder problem and introduce a reference probability measure Po under which 
the observations are coming from a compound Poisson process whose jump distribution does 
not change over time. In Section [3l we show that the disorder problem can be transformed 
into an optimal stopping problem for a Markovian sufficient statistic. The Markovian sufficient 
statistic may not be finite dimensional and we show in this section that it is finite dimensional 
when the distribution of the post disorder rate has finitely many atoms. In Section (U we find 
the autonomous sufficient statistic for any Bernoulli distribution. Also we set up an optimal 
stopping problem for a Bernoulli sufficient statistic when the post disorder rate can only move 
up. Section [5] contains some of our main results in which by performing a sample path analysis 
we either find the optimal stopping time exactly or provide upper and lower bounds. We also 
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show that the optimal stopping time is finite Po-almost surely. Section \6\ provides a useful 
characterization of the value function as a limit of a sequence o f other value functions. Since the 
proofs of the results in this section are similar to the ones in iBavraktar et al. l|2006l ) we omit 



them, except the result in which we show that the optimal stopping time we constructed is the 
smallest optimal stopping time and a few other that we prefer to keep for readers convenience. 



2 A Reference Probability Measure 



We will first introduce a reference probability measure Po under which the observations have 
a simpler form, namely they come from a compound Poisson process whose rate and jump 
distribution do not change over time. Next, we will construct the model that we briefly described 
in the introduction in the paragraph before (|1.4H . 

Let us start with a probability space Po) and consider a standard Poisson process 

N = {N t : t > 0} with rate fj,; independent and identically distributed strictly positive random 
variables Y\, Y2, ... with a common distribution (3q on M. d independent of the Poisson process; a 
random variable 9 independent of the previously described stochastic elements on this probability 
space whose distribution is given by 



P {<9 = 0} = vr, P {6> > t\9 > 0} = e~ xt , t > 0; 



(2.1) 



a random variable A independent of the other stochastic elements whose distribution is j(- 
This distribution charges only the positive real numbers. We will assume that 



m 



(k) 



(v - n) k ~{{dv) < 00, ke No- 



(2.2) 



Let the process X = {X t : t > 0} be the compound Poisson process defined as in (11. lj) and 
P = {J~t}t>o be the natural filtration of X. We will also define an initial enlargement of F, 
G = {Gt}t>o by setting Qt — V a{9,A}. Qt is the information available to a genie at time 
t that also observes the realizations of the disorder time 9 and post-disorder rate A. Let Pi(-) 
be a probability measure on M. d which is absolutely continuous with respect to /?o( - )- We will 
denote by r the Radon-Nikodym derivative 



r{y) = Wo iyl 



y e 



The process 

is a G-martingale where 



Zt 



l {r<t} + !{t><}> t>0, 



L t ^ e -(A-/0t Yl 



k=l 



-r{Y k ) 



The positive martingale Z defines a new probability measure P on every (f2, Qt), t > by 



dF 



Z t , t > 0. 



(2.3) 
(2.4) 
(2.5) 

(2.6) 



Note that since Zq = 1, P and Po agree on Go = a{9,A}, i.e. the random variables 9 and A 
are independent and have the same distribution under both P and Pq. On the other hand using 
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the G irsanov Theorem for jump processes (see e.g lCont and Tankovl ([20041 ) . iDavanik and Sezer 
(2006)) we conclude that the process X is a (P, G)-compound Poisson process whose arrival rate 
\x and jump distribution (3q changes at time 9 to A and (3±, respectively. In other words, on the 
probability space (D,, P), we have exactly the model posited in the Introduction section in the 
paragraph between (|1.3p and (jl.4p . 



3 Markovian Sufficient Statistics 



In this section, we will show that the stopping problem posed in (|1.5p can be formulated as 
an optimal stopping problem for a Markovian sufficient statistic, which is in general infinite 
dimensional. In the following sections we will see that depending on the structure of the prior 
of A the sufficient statistic can be finite dimensional. 



Let us denote all the F-stopping times by S and introduce the F-adapted processes 



lb 



< t\F t }, and 3> 



(fc) A E[(A- f i) k l mt} \F t 



k G N,t > 0. 



(3.1) 



lit is the a posteriori probability process and is the updated probability that the disorder hap- 
pened at or before time t given all the information up to time t. can be read as an odds-ratio 
process, and in fact = j^-- 

Using Proposition 2.1 in Bavraktar et al. ( 20051 ) we can write the Bayes error in (jl.5p as 



R t (tt) = 1 - vr + c(l - vr)E 



-At 



(0) 



T G 5, 



(3.2) 



where the expectation Eo is taken under the reference probability measure Po- As we can 
see from (|3,2p . finding an optimal stopping time for the quickest detection problem would be 
considerably easier if the process is Markovian and its natural filtration coincides with 
the filtration generated by the observations. In that case we would just have to solve a one- 
dimensional optimal stopping problem. This is not true, however, unless A has only one possible 
value to take. The following lemma shows that the whole sequence {$( fe )}fc e N is a Markovian 
sufficient statistic for our detection problem. This result also will help us develop sufficient 
conditions under which a finite dimensional sufficient statistic exists. 



Lemma 3.1 Let be as in \2. ty) . Then the dynamics of can be written as 

d<5>f ] = (A(m (fc) + $ t (fc) ) - $f +l) )dt + $g f (r(y) - l)p(dtdy) + f r{y)p{dtdy), 

(3.3) 

with f&Q^ = j^=rn^ k \ in which p is the point process defined by 



p((0,i]xA)i^l h < t} l 



{Y k &A}, 



t > 0, A G B(R d ). 



(3.4) 



fc=i 



Proof: Using Bayes' formula, and the independence of the stochastic elements 9, A and X 
we can write 



<j>(fc) = E o [( A ~ V) kz d{e<t}\ft] = (fc) ( fe) 
(l-n t )Eo[Z*|^i] * ^ * 



(3.5) 
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in which 



(k) A 



1-7T 

ct 



{v - /j,) k L^(dv), and 



Ae A M^|(i/-//) fe 7 (^)^- 



Here we have used the notation 



fc=l 



/i 



(3.6) 
(3.7) 

(3.8) 



To derive (|3.5p we have used (|2.4p . (|3.ip and the identity 

i-n. = "-'>°-", 

E [z,\r,] 

which we can derive using the independence of 6 and X under Pq. 

The process L v is the unique locally bounded solution of the equation (see e.g. Elliott ( 19821 )) 



-{y — [xjdt + 



-r(y) - 1 p(dtdy) 



with Lq = 1. Using 



and the change of variable formula it is easy to obtain 



da 



(k) 



(At/f - U^)dt + / ((r(y) - 1)EZ« + ^U?^) P (dtdy), 



(3.9) 



(3.10) 



with U, 



-r^—rrS^, and 

1 — 7T ' 



( r(y ) - ) + lM r c*+i) 



with V? = 0. Now ([33} follows from (|53|> 



p(dtdy). (3.11) 



□ 



Lemma [3 . 1 1 shows that is not a Markov process, and 2) the sequence {3>^}&eN bas the 

Markovian property and its natural filtration is the same as F. The following corollary gives a 
sufficient condition that the distribution of the post-disorder rate 7 must satisfy in order for the 
sufficient statistic to be finite dimensional. 



Corollary 3.1 If 7 is a discrete distribution with only k atoms then • • • , <3?( fc is 

a k- dimensional Markovian sufficient statistic. 

Proof: This follows from the same line of arguments used in the proof of Corollary 3.3 in 
Bayraktar et al. Here, we will give it not only for readers conveneience but also because 



the notation we introduce here will be used later. Let us denote by ui, ■ ■ ■ , v\. the atoms of the 
distribution 7 and define 



k fc-l 



p(v) = Yl(v-u i + n) = v k + ^2c i v i , v£R, (3.12) 



=1 



G 



for some suitable numbers cq, ...,Ck—i- Observe that the random variable 

fc-l 

p(A- j u) = (A-/i) fe + ^c i (A-/x) i = J a.s. 

8=0 

The last identity together with (|3,ip implies that 

fc-i 

$f ) +^c i $f =0, P-o.8. (3.13) 

i=0 

Now, it can be seen from the form of the penalty function in (|3.2p and the dynamics in (|3.3p 
that {<3?( ), • • • , <I>( fc_1 )} is a /c-dimensional Markovian sufficient statistic. □ 

In the remainder of the paper we will assume that the distribution for the post-disorder rate 
A has Bernoulli distribution. 



4 Post-Disorder Rate with Bernoulli Distribution 



In this section we will assume that the random variable A takes either the value fii > or \ii > 0, 
i.e. 7({^i,M) = 1- From ([3"^3]) it follows that ^ = (mi + fi 2 - 2//)*C 1 ) - (mi - m)(M2 - m)$ (0) - 
According to Lemma 13. 11 the pair 

($(0)^(1)) satisfies 

d^[ 0) = (A(l + $| 0) ) - $ t (1) )cft + / (r(y) - l)p(dtdy) + / r{y)p{dtdy) 

Jy£R d M Jy£R d 



d<S> 



(i) 



(Am (1) + (A - 0*i + /x 2 - + (Mi " M)(M2 " M)*D^ 



(i) 



+ / (r(y) - l)p(dtdy) + «Mi + M2 - 2fj)^ - ( m - rffa - [ r(y)p(dtdy) 

JyeR d M Jy£R d 

(4.1) 



with initial conditions <& 



(0) 




t*- and 

1— 7T U 



1-7T 



Instead of the sufficient statistic (<I>( ), ^W), it will be more convenient to work with 

~(0) 4 ¥{K = l i li e<t\T t } - (1) 4 P{A = /x 2 , g<t|^} 

* P{0>t|.F t } an * P{0>t|.F t } 

In fact the following a one-to-one relationship between these two pairs holds 



(0) 



(tt, - M)*i 0) - and f (i) _ (mi ~ m)^ 0) 



(i) 



M2 ~ Ml Ml - M2 

The dynamics of this new sufficient statistic are autonomous as can be seen from 

' ^ m<1> * + (A - w +rtif» )* + ••?/ 

Jy£R d 



d<S> 



(0) 



(i) 



M2 - Mi 

A(/ii — \x — m^) 
Mi - M2 



l + ^]r( y )-l 



+ (A-M2 + M)*r? d * + * 



1 + 



M 

M2 ~ M 
M 



(4.2) 
(4.3) 

p{dtdy) 

p{dtdy) 
(4.4) 
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When the number of atoms of the distribution 7 is more than two, we expect that sufficient 
statistics defined similarly will also be autonomous. 



The sufficient statistic we introduced in (|4.2p has a natural interpretation and is similar in 
flavor to particle filters: these are the normalized probabilities that are assigned to each atom 
Hi and these are updated continuously between the times of the observations, since not having 
an observation in fact reveals some information about the intensity of the underlying Poisson 
process. Indeed from (14. 4D we observe that the sufficient statistic (<|(°), cj^ 1 )) solves an ordinary 
differential equation between the observations, and the terms that involve the counting process 
p are inactive. When there is an observation, these normalized probabilities jump depending 
on the jump size of the observation. We will see the optimal alarm mechanism is to sound the 
alarm as soon as the sufficient statistic touches or jumps above a convex and decreasing curve in 
if the sufficient statistic starts below this curve. Otherwise it is optimal to sound the alarm 
immediately. Since the jump distribution also changes at the time of disorder, not only the 
timing of the observations but also the magnitude of the observations is informative. Therefore, 
it is reasonable to expect that we are able to construct a more acute alarm in this case than the 
case in which the observations are coming from a simple Poisson process where the jump size 
does not carry any information. 



In the case when the post disorder rate could go both up and down by one unit, i.e., fj,\ = /i- 
and ^2 = ^ + 1) then the dynamics in (j4.4f) become 



1 



^ f ) = iAa+m) +(A _ 1) ~( 1) , d t+4f) 



1 



r(y) - 1 



1 + - r(y) - 1 



p(dtdy) 
p(dtdy), 



(4.5) 



in which m = m 1 = P{A = \i + 1} — P{A = fj, — 1} 6 [—1, 1]. Observe that when an arrival 

comes, jumps down and jumps up. Assuming m G (—1, 1) then <&[ ^ is always increasing 
between the observations. $ W , on the other hand, can be increasing or mean reverting depending 
on the value of A. Note that the values m=-lorm = l correspond to the degenerate cases in 
which the post-disorder rate is known and the sufficient statistic becomes one-dimensional. 

On the other hand, in the case when the post disorder rate could only go up by one or two 
units, i.e., \i\ = fj, + 1 and ^2 = A* + 2, then the dynamics in (|4.4p become 



d$j 0) = |a(2 - m) + (A - 1)$S 0) } dt + &f} f 

Jy 

d&P = {\(m - 1) + (A - 2)${ 1} } dt + f 



1 + l ) r (y) _ 1 

1 + - ) r(y) - 1 



p(dtdy), 



p{dtdy), 



(4.6) 



in which m = 2P{A = /x + 2} + P{A = /x + 1} G [1,2]. Here the initial conditions are $[, 0) = 
(2 — m)j^ and ^g 1 ^ = (m — 1)t^— ■ We will assume that m G (1, 2) as otherwise the problem 
degenerates into a one-dimensional one. In the next section we will see that the intuition that a 
decision would sound the alarm only at the times when it observes an arrival does not in general 
hold; see Remark 15.11 This intuition becomes relevant only when A and c are small enough, 
i.e. when the disorder intensity and delay penalty are small. If A > 2 then both $^ and 
increase between the jumps, because the rate of disorder is high enough despite the fact that 



there have been no arrivals. When A G [1, 2), &{ ^ increases between the jumps and &\ L ' is mean 



8 



reverting. When A £ (0,1), both $^ and have mean reverting paths between arrivals. 

Since the post disorder arrival rate can only move up, both <&[°^ and have an upward jump 
when there is an observation. 

In the remainder of the paper we analyze the case when the sufficient statistic is of the form 
Note that in this case the penalty function in (|3.2|) becomes 



R t (tt) = 1 - vr + c(l - vr)E 



Let us define 



x(t,x ) 



y(t,yo) 



A(2-m) + e (A-l)t 



A-l 



x + (2 - m)i, 

' A(m-l) , e (A-2)t 
A — 2 

v y + 2(m- l)i 



. A(2-m) 



, A(m-l) 



c * 



A^l, 
A = l, 

A + 2, 
A = 2. 



t£(S. 



(4.7) 



and 



(4.8) 



Note that x and y satisfy the semigroup property, i.e., for every f £ R and s £ 
x(t + s,x ) = x(s,x(t,x )) and y(i + s,x ) = y(s,y(t,x )). 
Let us denote by a n the jump times of the process X. Then we get 



*(°) 



;(t-a n ,$(J) aIld =y(*-^n,^S)> *n < t < <Tn+l, 



$g) = (l + i)r(y n )$S_ and *g> = (l + ~) r(r n )i> 
The minimum of the Bayes risk in (|4.7p is given by; 



[/(vr) = inf R t (tt) = (1 - vr) + c(l - vr)F ( (2 - m)-^— , (m - 1) " 
res V 1 — vr 



n G Nn. 



(4.9) 



(4.10) 



1 - vr 



(4.11) 



in which V is defined as the value function of the optimal stopping problem for a two-dimensional 
Markov process 



re<5 



-At. 



5 $t U* 



with a running cost function 



Here, Eq '^ 1 is the conditional Po expectation given that $5 



5(00, 01 ) = 00 + 01 



(4.12) 
(4.13) 



(0) 



and $ 



(i) 
o 



5 Upper and Lower Bounds on the Optimal Stopping Time 



Unlike the optimal stopping problem for Ito diffusions, analyzing the sample path behavior of 
the piece- wise deterministic Markov process $ = ($i, $2), we are able to determine the optimal 
stopping time for most parameter values. For remaining parameter values we are able to provide 
some lower bound and an upper bounds on the optimal stopping time. 



9 



All the results in this section assume that an optimal stopping time exists and it is given by 
r*(0 o , 0i) 4 M{t > : V($ t ) = 0, $o = (0o, (5-1) 
In Section [6l we verify that this assumption in fact holds. With (|5.1]) we will call the region 



{(00, 0i) 6«l : «(0o,0l) =0}, 



A Tn>2 



\r, 



(5.2) 



the optimal stopping region. Let us start this section with a simple observation. 



Lemma 5.1 Lei us define 

t 1 4 inf{t > : $f } + $ t (1) > A/c}. (5.3) 
If there is an optimal stopping time for the problem in fi4-lty) > 1st us denote it by r* , then r* > t 1 . 

Proof: Let r G S be any stopping rule. Then 



tVt' 



e- A * 5 ($ t )dt 



< E^ 1 



e- u g{^ t )dt 



+ Eq' 01 



1{t*>t} / e- A ' 5 (<3> t )d* 



e - A < 5 ($ t )dt 



^o,0i e 



Here r V r' = max{r, r'}. 



(5.4) 
□ 



When the rate of disorder or c in (jl.5p are large enough, then in fact the lower bound t 1 
is optimal as the following proposition illustrates, i.e. the free boundary corresponding to the 
two-dimensional optimal stopping problem in (|4.12p can be determined completely. This is a 
very special instance of a multi-dimensional optimal stopping problem where an explicit deter- 
mination of the free boundary is possible. 



Proposition 5.1 If (i) A > 2, or, (ii) A G [1,2) and c > 2 — A, or, (Hi) A G (0,1) and 
c > max (2 — A, 1 — A), then the stopping rule t 1 of \5. 3\) is optimal for the problem in 

Proof: (i) Let us first consider the case A > 2. It is clear from the dynamics of the sufficient 
statistic in (|4.6ft that the sample paths of and are increasing functions of time. Therefore 
the process <I> does not return to the region {(0o,0i) G : 0o + 01 < V c l- Thus for every 
stopping time r G S 



e- xt g($ t )dt 



> E^ 1 



tVt' 



e- M g(<S> t )dt 



e; 



4>o,4>i 



e- xt g($ t )dt 



+ En 



l{r>ri} I e~ u g{<S> t )dt 



> E^ 1 



(5.5) 



(ii) If A G [1, 2) then any sample path of is still an increasing function of t, but the same is 
not true anymore for the sample paths of The paths of increase with jumps; between 
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the jumps the paths are mean reverting to the level X(m — l)/(2 — A). However, since the 
processes i*- ** and $W can only increase by jumps we have that 



&l 0) >x(t,(j)o) and > y(t, 0i), t>0 



(i) 



Therefore 



F(0 o ,0i)> infE^ 1 
res 



-At 



x(t,<f> ) + y(t,(pi 



dt 



(5.6) 



(5.7) 



Clearly if for any (0o, 0i) if the right hand side of (|5.7p is zero, then 1/ = 0, since we also know 
that V < 0. This can be used to find a superset of the continuation region. However, as we 
shall see shortly this superset coincides with the advantageous region 



C o = {(^o,0i) £«+ :0o + 0i < A/c}. 
Observe that it is not optimal to stop before <E> leaves the region Co- 

Let us take a look at the derivative of the integrand on the righthand side in (|5.7p , 
d 



(5.8) 



dt 



[x(t, O ) + y(t, 0i)] = (A - l)z(t, 0o ) + (A - 2)y(t, 0i) + A. 



The righthand side of (|5.9p vanishes if the curve t — > (x(t, 0o), y(i, 0i)) meets the line 

I : (A-l)x + (A-2)y + A = 0. 



(5.9) 



(5.10) 



Note that since A £ [1,2) the y-intercept of the line is such that > A. Since I is increasing 
and c > 2 — A, the intersection of I with the set Co is empty. Observe also that every t — » 
(x(t,4>o),y(t,4>i)) starting at (0o,0i) is decreasing and the derivative in (15. 9p is increasing. 
Therefore, t — > (x(t, 0o), y(t, 0i)) meets the line i at most once for any (0o,0i) £ 



Furthermore, if t — > (x(t,4>o),y(t,4>i)) meets I at t\ = tz(0o, (f>i), then the function 
t — > x(t, 0o ) + y(i, 0i ) is decreasing on [0, i/] and increasing on [ti, oo). If i — ► (x(t, 0o) 
j/(i, 0i)) does not intersect I, then the function t — > 0o) + y(£, 0i) is increasing on 
[0,oo). 

(5.11) 

Since the line Z does not meet the region Co for every (0o, 0i) E I we have that 0o + 0i > A/c. 
Now (I5TT1) implies that x(t,0 o ) + y(i,0i) - £ > for (0 o ,0i) 6 M+ - C and t > 0. This 
implies that the righthand side of (|5.7p is zero, which in turn implies that V(0o, 0i) = for all 
(0o, 0i) GM^-Co. 

(iii) If A € (0, 1), then both of the paths of x(t, 0o) and y(t, 0i) are mean reverting. Because 
of our assumption on c the line I in (I5.10P does not intersect with Co and lies entirely above this 
region. Let us denote the region between I and Co by 

Sh 4 {(0 , X ) e : 0o + 0i - A/c > 0, (A - 1)0 O + (A - 2)0i + A < 0}. (5.12) 

From (|5.9p it follows that x(t, 0o) + y{t,<j)\) > A/c if (0o,0i) G Sh. Therefore, the path t — > 
(x(t,<j>o),y(t,(j)i)) never enters the region Co if (0o,0i) ^ Co- Therefore, the righthand side of 
(|5.7p is zero, which in turn implies that V(4>q, 0i) = for any (0q, 0i) € — Cq- □ 
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Proposition 5.2 Assume A G [1, 2) and c G (0, 2 — A). Let us define 
D 4 {(00,0!) G : O < 05, o + 0i < £}U{(0 o ,0i) G : O > 05, 00 + 01 < A/c}, (5.13) 
in which (05,0J) = (A(-l + (2 - A)/c),A(l + (A - l)/c)) and 

'2- A 



e = y(-i*,A|— + 1 



where x 



-r,A 



0. 



TTien £/ie region D is a superset of the optimal stopping region. 
Proof: Let us note that (|5.7|) implies that 



F(0o,0i)> inf 
te[o,oo] 



-As 



x(s,0 o ) + y(«,0i) — H s 



(5.14) 



Because of the assumption on c the line in (|5.10p intersects the region Co defined in (|5.8j) . Note 
that I and the boundary x + y — A/c = 0of the region Co intersect at (05, 0^). By running the 
time "backwards", we can find £ and t* such that 

(O,e) = (x(-t*,05),y(-t*,0 1 )). (5.15) 

By the semi-group property (see (|4.9j) ). we have 

x(t*,0) = x(t*,x(-t*, 05)) = x(t* + (-t* ), 05) = x(0, 05) = 05, 

and, 

y(t*,0 = y{t\x{-t*,4>l)) = y (t* + (-t*), 0!) = y(o, 0D = 01. 

So, the curve i — > (x(t, 0), y(t, £)), t > 0, meets line Z at (0q,0*), and i/ in (j5.11[) equals to i*. 
This implies that 

*(*, 0) + y(t, > x (t*,0) + y(t*,0 = 05 + # = ~ 

and in particular £ > A/c. Now we will show that when A and c are chosen as in the statement 
of the proposition it is optimal to stop outside the region D. 

The curve t — ► (a;(i, 0), £)) divides into two connected components containing Co and 
the region 

M = M. 2 + - D) n {(x, y) G M+ : (A - l)x + (A - 2)y + A < 0} (5.16) 

respectively. Every curve t — > (x(t, 0o), y(i, 0i)), i > starting at (0o,0i) G M will stay in M, 
since from the semi-group property (|4.9p it follows that two distinct curves t — > (x(i, 0g), y(t, 0")) 
and i — > (x(t, 0q), y(i, 0i)) do not intersect. Therefore, i — > (x(t, 0o), y(£, 0i)), t > 0, (0o,0i) G 
M intersects the line Z in (|5,10p away from Co and (|5.1ip implies that x(i, 0o) + y(t, 0i) > A/c 
for any (0o,0i) G M. Now, from (|5.14p we conclude that V = since the infimum on the 
right-hand-side is equal to from the arguments above and we already know that V < 0. 

On the other hand, if (0 o ,0i) G {R 2 + - D) n {(x,y) Gl^:(A - l)x + (A - 2)y + A > 0}, 
the curve i — > (x(i, 0o), y(£, 0i)), t > does not intersect the line Z; therefore, the function 
t — > x(i, 0o) + y(t, 0i) is increasing and 

x(t, O ) + y(t, 0i) > x(0, 0o ) + y(0, 0i) > 0o + 0i > £ > -, < f < oo. 

c 

Again, the infimum on the right-hand-side of (I5.14|) is equal to zero, which implies that V = 0. 



□ 



12 



Remark 5.1 If A G [1,2) and c G (0, 2 — A), then the following line segment is a subset of the 
free boundary 

ff={(0o,0i) GR* : 00 + 01-^ = 0, 0i<0?}. (5.17) 

This set in fact in the entrance boundary of the stopping region (the boundary through which the 
path t — ► (x(t, 0o), y(t, 0i)) enters the stopping region). 

Proposition 5.3 Assume that A G (0, 1) and that < c < ( - 2 3 ^ A ^ m A ' ) . If furthermore c > 2^^, 
then 

A f / 1 J \ _ TTV) 2 1 3 1 1 . . . , A 



P=|(^o,^i)GK+:^o+2^i + 2~2 m ~c-°' ^° + ^ ~ c ~ ° J ' (5 " 18) 
is a subset of the optimal stopping region. 

If on the other hand, < c < 2 g~^ , then the first time time (3>( ', ^W) reaches the set, 

aL ^.b2 ,1, 3 1 1 



P ^ I (0o, 0i) € K : 0o + + j - 2 m ~ c ~ ° j ' (5-19) 
is an upper bound on the optimal stopping time. 

Proof: When < c < (2 3^ m A) , then the line I n lies entirely in C . The paths, 
t — > x(i, 00, 01 ), £ > 0, that do not originate in Co enter into this region through the boundary 
{(0o,0i) € : 0o + 0i = A/c} and once they cross into Co they never leave it again since 
x(t, O ) + y{t, O ) < 0o + 0i < A/c for any point (0 O , 0i) G C n {(0o, 0i) £l+:(A - 1)0 O + 
(A — 2)0i + A < 0}, which follows from (|5.9p . Therefore the infimum on the right-hand-side of 
(|5.14p is attained by either t = or t = oo if (0o, 0i) G — Co- Either one never stops, pays 
a penalty for being outside Co for a while and then enjoys being in this region ad infinitum, or 
stops immediately because the cost of the initial penalty is deterrent enough. Since 
roo / ^\ 13 11 

J U(i,0 o )+y(i,0i)--Jdt = 0o + -0i + ---m--, (5.20) 



the infimum on the right-hand-side of (|5.14p is attained by t = if (0o, 0i) G P, which in turn 

>J-A 
' 3— m 



implies that V(0o, 0i) = for any (0q, 0i) G P. Observe that, if < c < 2^^- then P = R. 



□ 



Remark 5.2 Observe that if X & (0,1) and 2^^ < c < jjrj^^ , i/ien f/ie following line 
segment is a subset of the free boundary; 

P^|(0o,0i)GM 2 ,:0o + 0i-^=O, 1 < 2 (-i^ + ^^U. (5.21) 

77ms region is in the exit boundary of the stopping region (i.e., the boundary through which the 
path t — ► (x(t, 0o), 0i)) exits /rom i/te stopping region). 

Proposition 5.4 Assume that A G (0, 1) and that 

(2-A)(l-A) <c<max(2 _ A;1 _ A ). (5.22) 
3 — A — m 

Then the region D defined in Proposition \5.2\ is a superset of the optimal stopping region. 
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Proof: From the assumption on the parameters A and c it follows that the mean reversion 
level M = ( "*) ; A (™ !) j f the path t — > (x(t,<po),y(t,ipi)), t > 0, is in the region [0, A/c] x 



l-A ' 2-A 

[0, A/c] — Co- Also, one can easily check that M £ I, in which I is as in (jS.lOjl . Line I and 
the boundary of the region Co intersect at (</>q,<^). Because c > (2 — A)(l — A)/(3 — A — m), 
the equation (as an equation in the i-variable) x(t, 0) = <pQ has a positive solution, t* and 
2/0 = y(—t*, (/>*) > 0. The rest of the proof follows by using the same arguments as in the proof 
of Proposition 15.21 

□ 



Remark 5.3 Observe that if X £ (0, 1) and c satisfies 15.22\) . then the following line segment is 
a subset of the free boundary 

b , 0i ) e R 2 + : <f> + </>!- ~ c = 0, (pi<\{l- ^—^) } • (5-23) 
Moreover, this set is a subset of entrance boundary of the stopping region. 



Remark 5.4 If the assumptions of Proposition 15.31 are satisfied, then it is optimal to sound 
the alarm only at arrival times of the observation. This corresponds to the case when the mean 
reversion level of the paths t — > (x(t, </>o), y(t, c/>i)) is inside the advantageous region Co, which 
is defined in h5. 8\) . Otherwise, since the paths of the sufficient statistic, t — > <3?t, may reach the 
stopping region continuously or via jumps, it might be optimal to declare the alarm between two 
observations. 



We will close this section by proving that the optimal stopping time r* is finite almost surely. 



Proposition 5.5 Let n be a positive number such that the region {(</>O)0l) : <fto + <fii > v} ^ s a 
subset of the stopping region. (The existence of r\ is guaranteed by Propositions \5.1§5.4\ )- Let us 
denote the hitting time of this region by t u . Then Eq '^ 1 ^"] < 7/(2 + l//i). This implies that r* 
is finite Pq almost surely. 



Proof: Since the compensator of p(dtdy) (defined in (|3.4|) ) is equal to fJ>f3o(y) we can write 
the dynamics of in (|4.6h as 



t/\T u — ^0 + 



/ \X{2-m) + (X-l)$f ) \dt + / /i$ t (0) / (l + i) r (y)_l 



f3 (dy)ds 



+ 



(0) 



1 + r(j/) - l] q(dsdy) 

tAr u 



{A(2-m) + A^ 0) }ds + ^ 



(0) 



t- 



1 



1 + - ) r(y) - 1 
A* 



q{dsdy), 
(5.24) 

in which q(dtdy) = p(dtdy) — /j/?o(y) Here, we have used the fact that J Rd r(y)(3o(y) = 1. The 
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integral with respect to q(dtdy) is an F martingale under the measure Pq, since 



tAT U 



(0) 



1 + - ) r(y) - 1 



Po(dy)ds 



< E, 



4>o,4>i 



t/\T U 



2 + - ] $ { ?}ds 



<t[2 + -r) 



Therefore 



E <Po,<Pi 



(0) 
tAr" 



|A(2-m) + A$J 0) }ds 



> A (2 - m)^ '^ [t A t u ] . 



On the other hand, 



^ u < max ( 77, ( 1 + - J r^J^VJ < r? (^1 + (l + - ) r(Y NtArU ) ) , 



almost surely; therefore 
E* oA [t A t u ] < 



A(2-m) 



<h 



(o) 

iAr 1 



< Eq '^ 1 



17 2 + 



+ M +1 j r(lj) 

1 



The result follows after an application of the monotone convergence theorem. 



□ 



In what follows we will consider the cases in which the parameters do not satisfy the hypothesis 
of Proposition 15.11 and construct a sequence of functions iteratively, using an appropriately 
defined functional operator, that converges to the value function exponentially fast. 



6 Optimal Stopping Time and Properties of the Value Function 
and the Stopping Boundary 



The usual starting point to calculate the value function in ( 14. 12[) and find the optimal stopping 
time would be to try to characterize the value function as the unique solution of the free boundary 
problem 

min{(.4 - X)v(ip) + g(ip), -v(<p)} = 0, (6.1) 

in which the differential operator is the inifinitesimal generator of the Markov process ($^°\ 
and whose action on a test function / is given by 



Af{<h,<k) 



Of 



•o, 4>i) [A(2 - m) + (A - l)M + ttH^o, 00 [A(m - 1) + (A - 2)^] 
o o<Pi 



/( (i + lV( y )0 O) h + l) r(//)o , j - /(«>,,.,) 



(6.2) 



The solution of the free boundary problem (|6.1|) may be identified by using certain boundary 
conditions (the smooth fit principle). The s mooth fit is expe c ted to fail for (16. ID at the exit 
bound ary of the stopping region. See e.g. iBavraktar et al. (2005), Ba vraktar and Davanik! 
([20061 ) for failure of the smooth fit principle when the infinitesimal generator A is a differential 
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delay operator (these papers consider one dimensional free boundary problems). Instead of the 
characterization of the value function as a solution of quasi- variational inequalities, we will use a 
new characterization of the value function of the optimal stopping problem in (|4.12p . Specifically, 
we will construct a sequence of functions iteratively, using an appropriately defined functional 
operator, that converges to the value function exponentially fast. This will let us show that r* 
in (|5.ip is the optimal stopping time. We will also be able to show the concavity of the value 
function and the convexity of the free boundary. 



6.1 Optimal Stopping with Time Horizon a Tl 



In this section, we will approximate the value function V with a sequence of optimal stopping 
problems. Let us denote 



V n ( 



■mm 



tA<j„ 



-At, 



g(^,W 



dt 



(6.3) 



n 6 N, and a n is the n th jump time of the process X. Observe that 



where {4>o,4>i) G 

(V^) nG N is decreasing and satisfies — 1/c < V n < 0. Since (<r n ) n >i is an almost surely increasing 
sequence, (V n ) n >i is decreasing. Therefore lim n V n exists. It is also immediate that V n > V . In 
fact we can say more about the limit of the sequence (V n ) n >i as the next proposition illustrates. 



Proposition 6.1 V n (cf)Q, 4>\) converges to V uniformly in ((/>o,0i) S M+. In fact the rate of 
convergence is exponential as the following equation illustrates: 



1 



c \fj, + X 



>v n (<h,<M-v(<i>o,<h.)>0' 



(6.4) 



Proof: 



e- xt g (<S> t )dt 



tAo-„ 



e- xt g [$ t )dt 



+ E 



</>0></>l 



^r^,} / e~ Xt 9($t)dt 



(6.5) 



The first term on the right-hand-side of (|6.5|) is greater than V n . Since <?(■,•) > — A/c we can 
show that the second term is greater than 



— E, 



4>o,4>i 



{r>cr n } 



e- Xs ds 



> ~E. 



4>o,<i>i 



1 

> — 



c \ A + ii 



(6.6) 



To show the last inequality we have used the fact that a n is a sum of n independent and identically 
distributed exponential random variables with rate [i (i.e. a n has the Erlang distribution). □ 



Next, we will show that V n can be determined using an iterative algorithm. To this end we 
introduce the following operators acting on bounded Borel functions / : Ml — ► 1R 



Jf(t,< 



),4>i) — Eq '^ 1 



e- Xs g(¥°\$U)ds + l {t > ai} e-^f^^ 



Jtf(4>o,4>i)- inf Jf{s, <f>o, 0i), tG[0,oo]. 

s£[t,oo] 



, t £ [0,oo], 

(6.7) 
(6.8) 
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Recall that under Po, °"l (the first time an observation arrives) has the exponential distribution 
with rate fi. Using Fubini's theorem we can write (|6.7|) as 

Jf(t, 0o, <f>i) = f e~^ s (g + fi- Sf) (x(s, fa), y(a, <hj)ds, t £ [0, oo], (6.9) 



in which x and y are the functions defined in (|4.8p and S is the linear operator 

sf(<Po, 01) = J Rd f (( 1 + l) r ^°' ( x + ^) r (f)^) ( 6 - 10 ) 

Below we list a few useful properties of the operator Jo. 

Lemma 6.1 For every bounded Borel function f : R+ — > R, i/ie mapping Jq/ is bounded. If f 
is a concave function, then Jo/ is also a concave function. If fi < f% are real value bounded 
Borel functions, then Jo/i < Jo/2- That is, the operator Jq preserves boundedness, concavity 
and ordering. 

Proof: Let us define ||/|| = sup (0o<} <, l)gB ,2_ |/(0o,0i)| < oo. Since g(-) > 5(0,0) = X/c and 
\\S(f)\\ < ll/H we can write as 

J f(t, 0o, <h) > - + Mll/ll) ^ e-( A+ ^ds = - + /i 
Since we also have Jq/(0o, 0i) < ^(0, 00, 4>i) = 0, we obtain 



~ + Mil/Ill T^< ^o/(0o,0i)<O, (6.11) 

which proves the first assertion. 

The second assertion follows since S(f)(-, •) defined in (|6.10j) is concave if / is concave, and 
the functions 0o ~~ * x{t,fa) and <j)\ — > y(t,(pi) are linear for every t > 0. The preservation of 
ordering follows immediately from (|6.9p , □ 



Corollary 6.1 Let us define v n : M.+ — > R 6y 

f o = and u n = JoU n -i. (6.12) 

Then, for every n € N, u n is bounded and concave, and — 1/c < i> n +i < w n < 0. Therefore 
v = lim n _» 00 ?; n) exists, and is bounded and concave. Both v n and v are continuous (not only 
in the interior of R+ ), they are increasing in each of their arguments, and their left and right 
partial derivatives are bounded on every compact subset o/M+. 

Proposition 6.2 For every n £ N, v n defined in Corollary lfi.il is equal to V n of 116. 3\) . For 

e > 0, let us denote 

<(0 O , 0i) = inf{t € (0, oo] : Jv n (t, (0 O , <f>i)) < Jo^n(0o, <h) + e}- (6-13) 
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And let us define a sequence of stopping times by Sf = rn($) A o~\ and 



qe A 
°n+l ~ 



ifo-! >r£ /2 ($) 
otherwise. 



^<7l + S n 

Here 9 S is the shift operator on Q, i.e., Xt o 9 S = X s+ f Then is e optimal, i.e. 



(6.14) 



e- xt g($ t )dt 



< V„(0o,0l) +£. 



3.15) 



6.2 Optimal Stopping Time 

Proposition 6.3 r* defined in 115. 1\) the smallest optimal stopping time for {^.12$ . 

We will divide the proof of this theorem into several lemmas. The following lemma shows 
that if there exists an optimal stopping time it is necessarily greater than or equal to r* . 



Lemma 6.2 



^(00,01 



inf Eq 0,9,1 

T>T* 



e- Xs g($ s )ds 



(6.16) 



Proposition 6.4 We have i>(0o,0i) = F(0o,0i) for every (0o,0i) G M+. Moreover, V is the 
largest nonpositive solution U of the equation U = JqU . 

As an immediate corollary to Propositions 16.11 and 16.41 and Propositions I5.1H5.41 which con- 
struct bounds on the optimal stopping region, we can state the following: 

Corollary 6.2 Let us define the optimal stopping regions 

r, = {(^o^i)6l 2 + :^ ^i) = 0}, C n ^M^\r n , nGN, (6.17) 

and recall that 

r = {(^o> 4>i) £ ^+ : v((f)o, 4>\) = o}, c^\r. (6.18) 

There are decreasing, convex and continuous mappings 7 n : M+ — > R+ , n 6 N ; and 7 : R+ — > R + 
such that 

T n = {(^o, 0i) e M+ : > 7n(0o)}, G N and T = {(0 O , 0i) € M+ : 0a > 7 (0o)}- (6.19) 

The sequence {7 n (0o)}neN *s increasing and 7(0o) = nm T 7n(0o) / or every O £ -tf ^ere 
are paths t ^ (x(i, 0o), y(t, 0i)), i > 0, (0o,0i) S Co, i/ia£ exit Co, £/ien ifoere exists ^ G [0,A/c) 
(^/ie waiwe o/£ depends on the parameter values) such that 7 n (0o) = 7(0o) = A/c — 0o / or 00 > 
i.e., £/ie /ree boundary coincides with the boundary of the region Co defined in \5.8\) . In fact if 
(i) A > 2, or, (ii) A G [1, 2) and c > 2 — A, or, (mj A G (0, 1) and c > max (2 — A, 1 — A) i/ien 
f = 0. // (iv) A G [1,2) and c G (0, 2 - A), (v) A G (0,1) and (2 - A)(l - A)/(3 - A - m) < 
c < max (2 — A, 1 — A), then £ = A(— 1 + (2 — A)/c). // on the other hand, A G (0,1) and 
c> 2(l-A)/(3-m) <c< (2-A)(l-A)/(3-A-m), then £ = (2 - A)/c + m - 3. 



18 



Lemma 6.3 Let f : Rl i— > R be a bounded function. For every t G M+ and (0o, 00 G R+, 



•/*/(0o, 00 = Jf(t, (0o, 00) + e- (A+ ^ J /(x(t, O ), 00)) • 



(6.20) 



Remark 6.1 Since V is bounded, and V = JqV by Proposition 16.41 we have 
JtV((j>o, 00 = JV(t, (0o, 00) + e' (A+M)t F(a;(t, O ), y(t, 00)) , t G 

for every (0o,0i) G R+. 

Let us define the F-stopping times 

C/ e = inf{i > : V($ t ) > -e}, e>0. 

By Remark 16. 11 we have 

V($u e ) > ~ £ on ^e event {C/ e < oo} . 



(6.21) 



(6.22) 



(6.23) 



Proposition 6.5 Let M t = e~ xt V($ t ) + Jq e~ Xs g($ s )ds, t > 0. For every n G N, e > 0, and 

(00,00 G , we W Ep'^Mo] = Ep'^iMu^J, i.e., 



1/(00,00 =K 



<f>o,<f>i 



rU E A<J„ ____ 



3.24) 



Proof of Proposition [6T3l First we will show that r* is an optimal stopping time. It is enough 
to show that for every e > 0, the stopping time U £ in (|6.22p is an e-optimal stopping time for 
the optimal stopping problem (|4,12p . i.e., 



e- Xs g(<S> s )ds 



o 



< V((p Q , 00 + e, for every (0 O , 00 G 



Note that the sequence of random variables 

l>U e /\CF n 

Jo 

is bounded from below. By (|6,24p and Fatou's Lemma, we have 



e- Xs g($ s )ds + e-W* A ^V($ UeAan ) > - \ e~ Xs - ds - - = — 

o c c c 



F(<^o,0O =liminfE 00 ' <P1 



/ r7n e- Xs g^ s )ds + e - x ^ A ^V^ UEAan ] 
Jo 



> Eq '^ 1 



e <Po,<Pi 



> E^ 1 



lim inf 

n— >oo 



U e A(Tn 



e- Xs g{<S> s )ds + e 



-A(t/ e Acr n ) 



e^^)^ + l {D - e<oo}e - AU «y($cr ( 



A(7 e 



e- Xs g(<S> s )ds 



e W^ 1 



l {U E <oo}Z 



by (ED 



e" As (7($ s )^ 
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for every (0o,0i) G K+. This shows that U £ is an e-optimal stopping time. 
Now we will show that r* is the smallest optimal stopping time. Let us define 

_ a It, if t > t*, 



r + T*off T , if t < r*. 



(6.25) 



Then the stopping time f satisfies 
e- Xs g($ s )ds 



-As, 



e" As 5($ s )(is + e- XT V{$ T 



Xr 1 e- Xs g($ S+T )ds 



o 



(6.26) 



e- Xs g(<S> s )ds 



Here the third equality follows from the strong Markov property of the process <&. Now the 
proof immediately follows. □. 

6.3 Structure of the Optimal Stopping Times 

Finally, let us describe here the structure of the optimal stopping times. For this purpose we 
will need the following lemma. 

Lemma 6.4 Let 

T n (0o,0i) = inf {s G (0, oo] : Jv n (s, (0o,0i)) = ^n(0o,0l)} (6.27) 
6e i/ie same as r^cfio, <f>\) in Proposition 1 6. Oft with e = 0. T/ien 

r n (0o,0i)=inf{t>O:u n+ i(x(t,0o),y(t,^i)) = 0} (inf0 = oo). (6.28) 

PROOF: Let us fix (0o,0l) G R+, and denote r n (0o>0i) by r n . We have Jv n (r n , (0q, (pi)) = 
JoVn(<j>oAl) = Jr n V n (<f> ,(/)i). 



Suppose first that r n < oo. Since Jov n = v n+ \, taking t = r n and w = v n in (|6.20p gives 
Jw n (r n , (0 o ,0l)) = J rn v n {<Po,^i) = Jv n (r n ,((p ,(j)i)) + e~^ x+ ^ Tn v n+1 (x(r ni cl) ),y(r ni cl) 1 )). 
Therefore, v n+ x(x(r n , O ), y(r n , 0i)) = 0. 

If < t < r„, then Jv n (t, (0 O , 0l)) > Jo^n(0o,0i) = Jr n v n(<t>o,<l>l) = Jtv n {<t>o, 4>i) since 
it I—*- J u v n {<i>o,<Pi) is nondecr easing. Taking £ G (0, r n ) and io = v n in (I6.20p imply 

JoVni^oAi) = Jtv n {<t>o,<t>i) = Jv n (t, (0 o ,0i)) + e~ (A+At) * f „+i (x(t, O ) , 2/ (*, <Al )) • 
Therefore, v n +i(x(t, 0o)> y(t, 0i)) < for every £ G (0, r n ), and (|6.28p follows. 
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Suppose now that r n = oo. Then we have v n+ i(x(t,cpo),y(t,(j)i)) < for every t G (0, oo) by 
the same argument in the last paragraph above. Hence, {t > : v n+ \(x(t, (j>o),y(t, </>i)) = 0} = 0, 
and (|OB|) still holds. □ 

By Proposition 16.31 the set T is the optimal stopping region for the optimal stopping problem 
(|4.12p . Namely, stopping at the first hitting time Uq = inf{i G R + : $( £ T} of the process 
5> = ($(°) 5 $(!)) to the set T is optimal for (|4T2l) . 

Similarly, we shall call each set r n , n G N a stopping region for the family of the optimal 
stopping problems in (j6.3j) . However, unlike the case above, we need the first n stopping regions, 
Y\, . . . , r n , in order to describe an optimal stopping time for the optimal stopping problem in 
(|6.3p (the optimal stopping times are not hitting times of a certain set). Using Corollary 16.41 the 
optimal stopping time S n = S® in Proposition 16.21 for V n of (|6.3p may be described as follows: 
Stop if the process $ hits T n before X jumps. If X jumps before $ reaches r„, then wait, and 
stop if <1? hits r n _i before the next jump of X, and so on. If the rule is not met before (n — l)st 
jump of X, then stop at the earliest of the hitting time of T± and the next jump time of X. 



7 Conclusion 



We have solved a change detection problem for a compound Poisson process in which the intensity 
and the jump size change at the same time but the intensity changes to a random variable with 
a known distribution. This problem becomes an optimal stopping problem for a Markovian 
sufficient statistic. We have analyzed a special case of this problem, in which the rate of the 
arrivals moves up to one of two possible values, and the Markovian sufficient statistic is two- 
dimensional, in more detail. We have shown that the intuition that a decision would sound the 
alarm only at the times when it observes an arrival does not in general hold, see Remark 15.11 
This intuition becomes relevant only when the disorder intensity and delay penalty are small. 
Performing a sample path analysis we have been able to find the optimal stopping time exactly 
for most of the range of parameters, and tight upper and lower bounds for the rest of the 
parameter range. This work has applications in insurance risk, in which the subject Poisson 
process can be viewed as the claim arrivals process for an insurance company. 
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